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ARITHMETIC PROPERTIES OF THE FROBENIUS TRACES DEFINED BY A 

RATIONAL ABELIAN VARIETY 

WITH TWO APPENDICES BY J-P. SERRE 


ALINA CARMEN COJOCARU, RACHEL DAVIS, ALICE SILVERBERG, AND KATHERINE E. STANCE 

Abstract. Let A be an abelian variety over Q of dimension g such that the image of its associated absolute 
Galois representation pa is open in GSp 2g (Z). We investigate the arithmetic of the traces a\ jP of the 
Frobenius at p in Gal(Q/Q) under p a ■ In particular, we obtain upper bounds for the counting function 
#{p < x : cl i lP = / } and we prove an Erdos-Kac type theorem for the number of prime factors of a\ :P . We 
also formulate a conjecture about the asymptotic behaviour of #{p < x : ai iP = /}. which generalizes a 
well-known conjecture of S. Lang and H. Trotter from 1976 about elliptic curves. 


1. Introduction 

Given an abelian variety A/Q, its reductions A p j F p modulo primes encode deep arithmetic global infor¬ 
mation. A primary question related to these reductions concerns their p-Weil polynomials, in particular the 
coefficients of these polynomials. 

In the simplest case when A has dimension 1, that is, when A is an elliptic curve over Q, for each prime p 
of good reduction the p-Weil polynomial is Pa, p {X) = X 2 — a p X + p £ Z[X], where a p := p + 1 — |A p (F p )|. 
The coefficient a p satisfies the Weil bound |a p | < 2 ^fp and is of major significance in number theory. For 
example, it appears as the p -th Fourier coefficient in the expansion of the weight 2 newform associated to A. 
The study of a p comes in several flavours, some having led to well-known problems in arithmetic geometry, 
such as the Sato-Tate Conjecture from the 1960s (now a theorem) and the Lang-Trotter Conjecture on 
Frobenius traces from the 1970s (still open). 

Briefly, the Lang-Trotter Conjecture lLaTrl on the behaviour of a p predicts that for every elliptic curve 
A/Q and every integer t £ Z, if End^/A) ~ Z or t ^ 0, and if we write Na for the product of the primes of 
bad reduction for A, then either there are at most finitely many primes p such that a p = t, or there exists a 
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constant c(A, t) > 0 such that, as x —> oo, 


fx 

n A {x,t) :=#{p<x : p \ N A , a p = t} ~ c(A,t)r ^—. (1) 

logo; 

The constant c(A, t) has a precise heuristic description derived from the Chebotarev Density Theorem, 
combined with the Sato-Tate Conjecture when Endjj(H) ~ Z and with a prime distribution law arising from 
works of M. Deuring and E. Hecke when EndjHM) qk Z. 

While the Lang-Trotter Conjecture remains open, several remarkable related results have been proven. 
When End^H) qk Z (the CM case) and t ^ 0, upper bounds of the right order of magnitude can be proved 
using sieve methods. When End^H) ~ Z and t 0, weaker upper bounds, unconditional or conditional 
(upon the Generalized Riemann Hypothesis, GRH), can be proved using effective versions of the Chebotarev 
Density Theorem; such bounds were first obtained by J-P. Serre lSe8fl Theoreme 20]. The currently best 
unconditional upper bound, tt a ( x,t) <Ca > was obtained by V.K. Murty [Mu96 , Theorem 5.1] (see 

4 

IWal for an earlier result), while the currently best upper bound under GRH, n A (x,t) <Ca — g5 i , was 

_ (log®)* 

obtained by M.R. Murty, V.K. Murty & N. Saradha [MuMuSal Theorem 4.2] (for very recent improvements 
on the exponent of the logs factor, see [Zy]). When EndjHH) ~ Z and t = 0, stronger results are known; 
in particular, the unconditional bounds (log log log log x)i+* <c ^ n A(x, 0) <C I* were obtained by E. Fouvry & 
M.R. Murty FoMul Theorem 1] and, respectively, by N.D. Elkies [El] using, as a key tool, M. Deuring’s 
characterization of supersingular primes [El- 

Inspired by these works, the main goal of our paper is to investigate the arithmetic of the Frobenius traces 
of a generic higher dimensional abelian variety A/Q; in particular: 

(i) we will prove upper bounds for the generalization of the counting function n A (x, t) and deduce results on 
the growth of the Frobenius traces; 

(ii) we will determine the normal order of the sequence defined by the prime divisor function of the Frobenius 
traces, and, more generally, we will prove an Erdos-Kac type result for this sequence; 

(iii) under suitable hypotheses, we will formulate a generalization of ©- 

Our main results mark only the beginning of such investigations in higher dimensions and we hope shall 
stimulate further research. 

Our main setting and notation are as follows. Let A /Q be a principally polarized abelian variety of 
dimension g. Let Q denote an algebraic closure of Q and let End^H) denote the endomorphism ring of A 
over Q. Let N A be the product of primes of bad reduction for A. 

We denote by 

p A :Gal(Q/Q) ^ GSp 23 (Z) 

the absolute Galois representation defined by the inverse limit of the representations 

p At m : Gal(Q/Q) —* GSp 2s (Z/mZ) 

2 














of Gal(Q/Q) on the m-torsion A[m] C A(Q) for each integer m > 1. For each prime £ we denote by 

Pa,i '■ Gal (Q/Q) —> GSp 2 s (Z^) 

the Gadic representation, i.e., the representation of Gal(Q/Q) on the Gadic Tate module lim A[£ n ], 

For each prime p \ Na, we consider the p-Weil polynomial Pa, p {X) of A , which is uniquely determined 
by the property that 

Pa, p ( X ) = det ( XI 2 g ~ PA,i (Frobp)) (2) 

for any prime £ ^ p. In particular, we have 

Pa, p (X) = det ( XI 2g - pA,m (Frobp)) (mod?n) (3) 

for any integer m coprime to p. We write 

Pa, p (X) = X 2 Q + a\ pX^ a 1 + ... + CLg pX® + pcig— i p X a 1 + ... + p® ^a±pX Tp® G 7L\X\, 

where the integers aq p , 1 < * < g — 1 , are independent of £. 

For any integer t £ Z, we consider the function 

ka{x, t) :=#{p<x:p \ N a , a 1}P = t} . 

The reason we usually impose the restriction that our abelian varieties be principally polarized is for ease 
of notation. When the abelian variety is principally polarized, the image of the Gadic representation pA,e 
lies in GSp 2 g (Z^). Without the restriction on the polarization, the image lies in a group that can be defined 
by replacing the matrix J 2g of Section [2.11 below with a matrix that has a more complicated description, and 
our results could be modified accordingly; see, for example, Section 2.3 of [Se 86 j for the group of symplectic 
similitudes in this general setting. 


Theorem 1. Let 7l/Q be a principally polarized abelian variety of dimension g and let t G Z. Assume that 
Im pa is open in GSp 2 g (Z). Define 


2 p 2 +fl + l’ 


P '■= 


if 9 = 1; 


2G-g+3 */3>2, 


7 := 


For any e > 0 we have: 

(11) unconditionally, 

(12) under GRH, 


n A {x,t) «A,e 


x 

(loga:) 1+ “ _E ’ 


TT A (x,t) <^ A ,e X 1 2 + E ; 

(ii) if t 7 ^ ± 2 g, then (il) and (i 2 ) hold with a replaced by (3; 

(iii) if t = 0 , then (il) and (i 2 ) hold with a replaced by 7 . 


\ if 3=1; 
| if 9 = 2, 

wk+i */ 5 > 3 . 


3 








Note that we will actually prove a more general result, stated as Theorem Q3] in Section |1J and that the case 
g = 1 of Theorem [T| is |Se811 Tlreoreme 20, p. 189]. 

An immediate consequence of Theorem |T] concerns the non-lacunarity of the sequence (ai. p ) p : 

Corollary 2. We keep the setting and notation of Theorem\7\ For any e > 0 we have: 

(i) unconditionally, 

#{p< x :p\N A ,\ai, P \ > (logp)“" £ } ~ n(x)-, 

(ii) under GRH, 

#{p<x :p\ N a , |ai, P | > ~ e } ~ n(x). 

Recall that v(n) denotes the number of distinct prime factors of a positive integer n and that an arithmetic 
function /(•) is said to have normal order F{-) if for all e > 0, then (1 — e)F{n) < f(n) < (1 + s)F(n) for 
all but a zero density subset of positive integers n. It is a classical result of P. Erdos, originating in work of 
G.H. Hardy and S. Ramanujan [ HaRal . that v(p — 1) has normal order loglogp. More generally, P. Erdos 
and M. Kac [ErKal proved that v(p — 1) has a normal distribution. Variations of these results have also 
been obtained in arithmetic geometric contexts, including that of modular forms [MuMuj . We now prove 
such results in the context of abelian varieties: 

Theorem 3. Let A/Q be a principally polarized abelian variety of dimension g. Assume that Imp a is open 
in GSp 2 ff (Z). Under GRH we have that, for any r?I, 

lim # {p < x : p \ N a , ai, p ^ 0, v{ai, P ) < loglogp + Tydoglogp} _ 1 r T ^ ^ 

a; - >00 n{x) J -oo 

In particular, v(a i iP ) has normal order loglogp. 

The case g = 1 not only recovers, but also generalizes the main theorem of |MuMu) for weight 2 newforms 
that are not of CM type. 

Finally, in Conjecture [I] below we propose a generalization of © to the case of higher dimensional abelian 
varieties for which Imp^ is open in GSp 2 g (Z) and for which the following holds: 

Equidistribution Assumption: the normalized traces ^=- are equidistributed on [—2 g, 2 g\ with respect to 
the projection by the trace map of the (normalized) Haar measure of the unitary symplectic group USp(2g). 

The assumption that Imp^ is open in GSp 2 g (Z) gives rise to an integer m A > 1 that is the smallest 
positive integer m such that 

PA(Gal(Q/Q)) = n - 1 (ImpA,m), 

with n : GSp 2 g (Z) —> GSp 25 (^/mZ) the natural projection. 
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The Equidistribution Assumption gives rise to a continuous function $ : [—1,1] —> [0,oo), nonzero at 0, 
with the property that for every interval I C [—1,1] we have 


#{p<x:p\N A ,£*=el} 


lim 

x—too 


t{x) 


j $(i) dt. 


We propose: 


Conjecture 4. Let A/Q be a principally polarized abelian variety of dimension g and let t G Z, t ^ 0. 
Assume that Imp^ is open in GSp 2 g (Z) and that the Equidistribution Assumption holds. Then, as x —> oo, 

n A (x,t) ~ c(A,t)-^l, 
logx 

where 

$(0) m A ,t\C(m A ,t,t)\ n ^ (t)+1 | {M G GSp 2 j (Z/rW + 1 Z) : trM = t(mod^W+ 1 )}| 

C ’ ' 9 \I™PA, mA , t \ |GSp 29 (Z/^W+iZ)| 

tfte integers ve(t) > 0 are defined by £ Ve ^\t, £ v A t )+ 1 and 

m A ,t ■= m A 

t\m A 

C(m Att ,t ) := {M G ImpA,m A , t : trM Elfmodm^)} . 

If c(A, t) = 0, we interpret the asymptotic as saying that there are at most finitely many primes p such that 

nip = t. 

For a discussion about the possible growth of n A (x, 0), see Section 5. 

Remark 5. The image of p A is open in GSp 2 s (Z) for a large class of abelian varieties. Indeed, in iSe 86 . 
ISeSfibisj Serre showed that this holds whenever End^A) ~ Z and the dimension g of A is 1, 2, 6 , or an odd 
number. An open image result also holds when Endjj(A) — Z and there exists a number field K such that 
the Neron model of A/K over the ring of integers of K has a semistable fibre of toric dimension 1; see [Hal . 
As pointed out in [Hal p. 704], for g > 2 the image of p A is open in GSp 2 g (Z) for most abelian g-folds that 
arise as Jacobians of hyperelliptic curves defined by y 2 = f(x) with the degree n of the rnonic polynomial 
/ G Z[x] equal to 2g + 1 or 2 g + 2. Specifically, the hypotheses in Hall’s Theorem are satisfied if the Galois 
group of / is S n , or if there exists a rational prime p for which /(modp) has n — 1 distinct zeroes over an 
algebraic closure, one of which is a double zero; see E. Kowalski’s appendix to [Ha] and Yu. Zarhin’s paper 

[zann] . 

Remark 6. When Imp^ is open in GSp 2 g (Z), the Equidistribution Assumption is a very special case of 
a general conjecture explained in §13 of [Se94 1 Conjecture 13.5] that generalizes the Sato-Tate Conjecture. 
See also [CYS^ pp. 173-174, 797-804, 906] and [S^fibj . 
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Remark 7. Generalizations of the Lang-Trotter Conjecture m have been previously considered by other 
authors. For example, in [Mu99| . V.K. Murty addressed generalizations in the setting of modular forms, 
while in [Ka09l pp. 421-423], N. Katz addressed generalizations in the setting of abelian varieties arising as 
Jacobians of genus g curves. Our conjecture encompasses a generic class of abelian varieties A and is precise 
in terms of both the growth in x and the constant depending on A and t. The potential vanishing of the 
constant c(A,t) is an important open problem in itself. In |Ka09, p. 420], for instance, Katz discusses a 
general mechanism that leads to congruence obstructions for realizing ai iP = t. We relegate this study to 
future work. 

The paper is structured as follows. In Section 2 we present some of the key results needed for proving 
Theorem [TJ Corollary [2] and Theorem [3] and for arguing towards Conjecture 3] In Section 3 we prove 
Theorem [1] and Corollary [2] using the strategy of }Se81 , Sections 7-8] and also with the help of the main 
result of Serre’s Appendix lAl of this paper. In Section |4] we prove Theorem [3] following a general strategy of 
11 >i711 . In Section 5 we provide our heuristic reasoning towards Conjecture [I] and address some connections 
with existing works. In Section 6 we provide computational data related to our theoretical investigations. J- 
P. Serre supplied two appendices: the first gives a result on the dimension of conjugacy classes in symplectic 
groups, while the second gives properties of a certain density function for unitary symplectic groups. 

Acknowledgments. The authors thank Jeff Achter, Alina Bucur, Hao Chen, Francesc Fite, Nathan Jones, 
Kiran Kedlaya, Emmanuel Kowalski, Antonella Perucca, Karl Rubin, Jean-Pierre Serre, Drew Sutherland, 
Cassie Williams and Jonathan Wise for valuable discussions related to this paper. They are grateful for the 
hospitality of the Banff International Research Station, Alberta, Canada, and the support of the organizers 
Chantal David, Matilde Lalin, and Michelle Manes of the conference Women in Numbers 2 (2011), where 
this work was initiated. The last three authors thank the first for her leadership and hard work on this 
project. 


2. Generalities 

2.1. Basic notation. Along with the standard analytic notation O, <C, 3>, o, 

ir(x) := #{p < x : p prime}, 


li cc := 


1 


dt, 


h log* 

we use p and i to denote rational primes; we write n|m°° to mean that all the prime divisors of n occur 
among the prime divisors of to, possibly with higher multiplicities; we write n||m to mean that n|m, but 
n \ to; we write i>e(n) for the valuation of n at t. 
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For a commutative, unitary ring R and a positive integer g , we denote by R x its group of units, by 
4 e M g (R), i 2g £ M 2g (R) the identity matrices, and by 


J 2 g 


0 


~Ig 0 


e M 2g (R). 


We recall that the general symplectic group on R is defined by 

GSp 2 g (i?) := {M £ GL 2g {R) : M* J 2g M = gJ 2g for some g £ R x } , 
where M t denotes the transpose of M, while 

Sp 2 g (i?) := {M £ GL 2g (R) : M t J 2g M = J 2g } ■ 

We note that GSp 2 (i?) = GL 2 (i?). We recall that GSp 2 ff (i?) has center {gl 2g : g £ R x } and that, as an 
algebraic group, it has dimension 2g 2 + g + 1 . 

For R = C, we recall that the unitary symplectic group is defined by 

USp(2g) := |m G Sp 2g (C) : M*M = MM* = I 2g |. 

2.2. The Chebotarev Density Theorem. 

2.2.1. Finite extensions of a number field. Let L/K be a finite Galois extension of number fields and let G 
be its Galois group. Let C be a non-empty subset of G that is stable under conjugation. For any x > 0, let 


ttc{x,L/K) := #{p a place of K. unramified in L/K : N K/ 
The Chebotarev Density Theorem states that 

tt c (x,L/K) ~ j^Trta:). 

We will use the following conditional effective version of this theorem: 


< x, Frobp C C}. 


Theorem 8. / ^LaOdj : for this version see |Se811 Theoreme 4, p. 133]^) Keep the above setting and notation. 
Assume GRH for the Dedekind zeta function of L. Then there exists an absolute constant c > 0 such that 


Tr c (x,L/K) - j^j tt(x) 


< c j^j^ (1°S I disc(L/Q)| + \L : Q| logs). 


In order to apply this theorem, the following variation of a result of Hensel [He], proved in |Se81| . is useful: 
Proposition 9. f ]Se811 Prop. 5, p. 129]) Keep the above setting and notation. Then 

log\N K/q (disc{L/K))\ < (\L : Q| - \K : Q|) | ^ logp J + \L : Q| log \L : K\, 

\ P GV(L/K) J 

where 


V(L/K) := {primes p : there is a place p of K, ramified in L/K, with p|p}. 
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2.2.2. I-adic extensions of a number field. In |Se81j . Serre used the effective versions of the Chebotarev 
Density Theorem of Lagarias & Odlyzko ILaOd] to deduce upper bounds for ttc(x, L/K) in the case of an 
£-adic Galois extension L/K of a number field I\. We recall his main results below. 

Let K be a number field. Let £ be a rational prime and G a compact Gadic Lie group of dimension 
D. Denote by Z(G) the center of G. Let C C G be a non-empty closed subset of G that is stable under 
conjugation. In [Se811 Section 3] Serre explains what it means for the Minkowski dimension dimx C of C 
to be < d. Let L/K be an infinite Galois extension, with Galois group G. For any x > 0, let 


nc(x, L/K) := #{p a place of K, unramified in L/K : N K /q(p) < s,Frob p C C}. 
Following lSe81 . p.151], we define 

log a" 


- 0 ) := 


(log log X) 2 (log log log X) 


and cr(x) := 


£2 


(log x) 


2 ' 


Theorem 10. ( |Se 8 ll , Theoreme 10, p. 151],) Keep the above setting and notation. Let 0 < d < D be such 
that the Minkowski dimension of C satisfies dim^j C < d. Define a := 


D 


(i) Unconditionally , we have 


n c{x,L/K) <^k,l,c 


li x 

s(x) a 


In particular, for any e > 0, we have 


TTc(x,L/I<) <^K,L,C,e 
(ii) Under GRH for Dedekind zeta functions, we have 


(logs) 


1 + 0 ! — £ ' 


7 t c {x,L/K) <Z^k,l,c 


li x 


£r{x) c 


In particular, for any e > 0, we have 

ir c (x,L/K) <^K,L,C,e S 1 ~^ +£ . 


Serre obtains the following improvement in special cases: 

Theorem 11. f |Se811 Theoreme 12, p. 157]) Keep the above setting and notation. Let 0 < d < D be such 
that the Minkowski dimension of C satisfies dim^ C < d. Define 

rc ■= inf dim — 7 ——, 

Mec Zq{M) 

where Zg(M) denotes the centralizer of M in G. Define 

D-d 


Pc~ 


^ 2 


Then ( i ) and (ii) of Theorem\TU[ hold with (3c in place of a. 

Note that rc > 0, hence (3c > ot and so Theorem [Tl] is Theorem ITOl when /3c = a. When rc > 1, hence 
(3c > a, Theorem UT1 improves upon Theorem flT)l This happens when C D Z(G ) = 0. 






















2.3. Abelian varieties. Let A/Q be an abelian variety of dimension g and let p be a prime of good 
reduction. Recall that for any root n G C of Pa, p {X) we have | 7 r| — ^Jp, hence 

K,p| < 2 g^/p. (5) 

Property m links the p-Weil polynomial Pa, p {X) to the division fields of A, in particular to the Galois 
representation defining pa- 

For arbitrary integers m > 1 and t , we set 

G(m) := Im p A ,m, 

C(m,t) := {M e G{m) : trM = t(mod to)}. 

We recall that: 

• by the Neron-Ogg-Shafarevich criterion, 

the extension Q(A[m])/Q is unramified outside ( 6 ) 

• by the injectivity of the restriction of pA,m to Gal(<Q>(A[m])/Q), 

\G(m)\ < | GSp 2 g (Z/mZ)| < m 2 a 2 +a+\ (7) 

In many cases, the image of the representation pa is better understood. For example, as already mentioned 
in Remark[5]of Section[l] for several classes of abelian varieties A /Q with a trivial endomorphism ring, Imp^ 
is open in GSp 2 fl (Z). In particular, for such A we have that: 

• Im pA.e is open in GSp 2 ff (Z^) for all rational primes £; 

• G(£) ~ GSp 2 g (Z/ffl) for all but finitely many rational primes l. 

Lemma m below gives further consequences of the openness of Imp^ in GSp 2 g (Z). To state the lemma, 
we introduce the following notation: 

m\C(m,t)\ m\{M G GSp 2 g (Z/mZ) :tiM = t(modm)}| 

-Gtyfl) • I 7 Tf ' tltyYl) . I p Q trjj 7 rjj \ I ■> 

\G{m)\ I GSp 2 g (Z/mZ)| 

for a sequence (s„) n , 

lim s m := lim s mn with m n := I I £ n . 

m —y oo n —>oo 

£<n 

Lemma 12. Let A/Q be a principally polarized abelian variety of dimension g such that Imp^ is open in 
GSp 2 g (Z). 

(i) There exists an integer m > 1 such that /cpt(Gal(Q/Q)) = II^ 1 (G(m)), where we recall that 

n : GSp 2 g (Z) —^ GSp 2g (Z/mZ) 

is the natural projection. Denote by tua the least such integer. 

(ii) For all positive integers m\,ni 2 with and (iri 2 ,mA) = 1, we have 

G(mim 2 ) — G(mi) x G(to 2 ) = G(mi) x GSp 2 g (Z/m 2 Z). 
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(iii) For all t £ Z we have 


In particular, if t y 0, then 


(iv) For all t G Z, t y 0 , we have 


Y[H t (£) < oo. 
e 

H t 


< oo. 


i\m A 


lim F t (to) = F t | toa n £'««(*) j . H t (r* (t)+1 ) . 


£|myi 


£fr7lA 


Proof. Parts (i) and (ii) are clear from the openness assumption on IrnpA- For part (iii), let £ \ m.A and t 
be fixed. First, we will show that 

e\c(e,t) | 


= 1 + 0 


( 8 ) 


| GSp 2g (Z/£Z)| 

Recall that the multiplicator of GSp 2 g (Z/TZ) is the character of GSp 2 g (Z/TZ) with kernel Sp 2 g (Z/TZ); we 
denote it by mult. Let char(M) denote the characteristic polynomial of a square matrix M. For 7 £ (Z/TZ) X , 
define 

GSp 2 g (Z/t'Z ) 7 := mult -1 ( 7 ), 

C(£, ty := C{ 1 , t) 0 GSp 2g (Z/«) 7 , 

gyy ■- {ch ar (M) : m g Gs P2g (z/«) 7 } , 
c(£, ty := {m e gyy ■. tr m = t} . 

By i AcHol Lemma 2.4, p. 631], 

£ \ 2g2+9 \c(£,ty\ . 1 ca,ty\ .( £ \ 2g2+9 \cy,ty\ 


£+1 


\c(£,ty\ \c(£,ty\ 

\gyy\ ~ |s P2g (z/«)| - \i- 1 


mv 


Noting that \C{£,ty\ = t 9 1 and |C?(£) 7 | = we deduce that 


2 5 +P 


1 < |C(^) 7 | 


< 


i ~ |Sp 2g (z/«)| - \£-i 


2 P +5 


Combining the above inequalities for all 7 £ (Z/£Z) X and multiplying by H gives 


,£+l 

This completes the proof of ©. 
Next we will prove that 


2 0 +<? 


< 


t\C(£,t) | 

GSp 2 (Z/ffl)| - V^- 1 


< 


2 5 +5 




= 1 + 0 


1 

£ 2 ; • 


|GSp 2g (Z/ffl)| 

This ensures the convergence of the infinite product J^ifi(£), proving (iii). 

l 

We first prove © for t y 0. For this, observe that for any t\, t 2 £ Z we have 

t\ = t 2 (mod£) => C(£,t±) = C(£,t 2 ) 


( 9 ) 
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and 


t\ ^ O(mod^), t 2 ^ O(modf') => |C(£,<i)| = \C(£,t 2 )|. 

Indeed, the first assertion is trivial, while the second assertion follows by noting that, if t\ ^ O(modf') 
and t 2 ^ O(mod^), then the endomorphism [t 2 ti ] of GSp 2g (Z/£Z) defined by multiplication by t 2 ti is a 
bijection satisfying that [t 2 tj~ ] (C(£,ti)) = C(£,t 2 ). 

From the above observations, 


| GSp 2g (Z/«)| = | C{£, 0)| + (£ - 1) | C{£, t)\. 


It is now easy to show that 0 follows from this along with (0 for |C(£,0)|. 

Now we prove m for t = 0. When g = 1, a straightforward calculation gives that 


| C '(€, 0 )| = £ 3 -£ 2 


and so 


W, 0)1 


£ 3 {£- 1) 


|GL 2 (Z/TZ)| £(£ — 1)(£ 2 — 1) £ 2 -l 

When g > 2, we proceed as follows. By |K]] Theorem 5.3, p. 170], 


-1 + ofil. 


p 


\C(£,t)\ = g(£) 


( 10 ) 


-rV(€) if M0, 

£~\£-l )f(£) if t = 0, 

for some explicit polynomials /(£) and g(£) in £. Of relevance to us is that the degree d g ^ of the leading 
term of g{£) in £ satisfies 

d g (i)=2g 2 +g, ( 11 ) 

and that the degree df^ of the leading term of f{£) in £, while less explicit, can be shown to satisfy 

3 g 2 , g 


df(t) <- + - + !• 


( 12 ) 


2 2 

Before justifying this bound, let us complete the proof of 0 for t = 0, g > 2. From (TTOj) , we see that for 
any t ^ 0, 

\C(£,0)\=m + \C(£,t)\. 

Since we already know 0 for t ^ 0, it suffices to show that 


m) 


= oii). 


|GSp 2g (Z/«)| \P / 

This follows from m and C2D, as well as the assumption that g > 2; indeed, 

d g(t) ~ d f(t) >tt + ^- 1 > 2 - 


2 2 


Consequently, m holds for t = 0, g > 2. 
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Finally, let us justify m- The expression for /(£) is rather delicate; indeed, Kim showed that 


Ls/2J 26-1 , 6 L(9-2b+2)/2J 

m = f'~ l E n L_ m _, n^ -1 -!) E 


6=0 


fc=l 


E A '(«) 


fe-i 


g—26+2—2/c 


e ( is ) 


aGFf 


ilr-iife-l 11=1 

2fc-l<7 fc _ 1 <-<ji<g-26+l 


where K (a) is the ordinary Kloosterman sum 

K (a) = A'(A; a, 1) := E] A(aa + a _1 ) 


aGF,? 


for any non-trivial additive character A of F g . 
To find the leading term, we first focus on 


E K ^ r 


c*gf; 


for an arbitrary integer r > 0. 

When r = 0, the sum is simply l— 1. When r = 1, by Weil’s estimate on Kloosterman sums |/v(a)| < 2y/I, 


we deduce that 


E *(«) 


c*GF, 


< £ 2 . When r > 2, Kim remarks that 
E A'(a) r = £ 2 M r _! - (£ - l) r_1 + 2(—l) r_1 , 


c«GF* 


where Mq := 1 and for any integer s > 1, 

M a := | |(oq,... a s ) € (F^) s : a.\ + ... + oc s = 1 and cti + ... + o; s = l} | 


Note that Mi = 1 and that for s > 2, the first of the two conditions defining M s gives oq linearly in terms 
of the other oq, while the second gives as a root of a quadratic in the remaining terms. Thus, if s > 2, 
then M s < 2(£ — l) s_2 . It follows that when r = 2, the sum X^gf x K{a) r is bounded by an expression of 
leading degree at most 2 in £ (by direct computation using M i), and when r > 3, by an expression of leading 
degree at most r — 1 in l. 

Using the above estimates, we now focus on the degree of the leading term in (fl3l) ; we deduce that 


df(i) < max \g 2j r 2bg — 2 b 2 + b + k + kg — 2 bk — k 2 + 1 : 0 < b < 


9 ~\ 

.21 ' 


l<k< 


g — 2b + 2 


The quadratic function above is maximized when b = |_§J and k = [ g ~ 2j ’+ 2 J = 1, with maximal value 
+ | + 1; the bound (fT^l) follows. This proves ©, and therefore the first part of (iii). 

To prove the second part of (iii), observe that t 0 is divisible by at most finitely many primes, and so 
H t is a constant multiple of hence finite by the first part of (iii). 

i\rriA & 
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Now we prove (iv). Fix an arbitrary t £ Z with t ^ 0. For now, fix also a positive integer m such that 
(to, m^) = 1 or to^|to, and a prime divisor £ of m. Write m = mo£ Ve ^ m \ t = to£ v ^ t \ where too, to £ Z satisfy 
£ \ too, £ \ to, and note that ve(m) > 1. For any s £ Z such that s = t(modm£ Ve ^), we have vg(s) = vi(t) 
since Vf.(m) > 1. Therefore we may write s = So£ ve ^ with so £ Z and £ \ so- By the Chinese Remainder 
Lemma, there exists u £ Z such that u = tg ^o (mod£) and u = l(modTOo), hence such that 

ut = s(modr (t)+1 ) , (14) 

u = l(mod?7i). (15) 


We have 

ul 2g £ G{m), (16) 

since if (to,to^) = 1 then by (ii) we have G(to) = GSp 2g (Z/TOZ) and so ul 2g £ G(m), while if toa|to. then 
u = l(modTOA) (by (fl5l) l and 

| M £ GSp 2g (z^ : M = 1 (mod toa) j C ImpA 

(by the definition of toa) and thus ul 2g £ G(m). 

Using m and m, we deduce that the multiplication by ul 2g map 

C (to ^W +1 , tj —> c(m r^ t)+1 , s) 

M i ^ uI 2g M 


is a bijection; in particular, 

c(m£? l W +1 ,s) = C (m £ ve( ~ t)+1 ,t 
Now consider the natural projection 

n: g (to r* (t)+lN 1 —G 

and observe that 


n _ 1 (/2 9 )| 


G 


G 


Letting 


S := js (modmf'^j : s = t (mod 

and using ED. we obtain 

|n _1 (/ 2fl )| • | C[m£ v ^\t) 




n- 1 c 


(J c(m£ VeW+1 ,sj 

s(mod 


(17) 


(18) 


c(m£ ve W +1 ,t) 
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giving 


I n_ 1 (/ 2 fl}|- c(m£ Ve{t) ,tj = £■ 

Putting together (fI51) and m, we deduce that for all positive integers m such that ( m,rriA ) 


( 19 ) 


= 1 or 


to/ i |m. and for all primes £ | to, we have 

F t 

and thus 


= F t 


F t ( m £ k ) = F t (m£ Ve ^j for all k > ve(t). 


Therefore for all d | tua we have 

F t | d rriA TT £ Ve(t ' > ] = F t | to a n £ve(t) 

\ t\m A / \ t\m A 

and for all k > 1 and all primes £ { iti a we have 

F t = Ft 

Now for any positive integer m consider its unique factorization 

to = mi • to- 2 , with rrii\mA and (m 2 , itia) = 1- 

By (h), 

F t (to) = F t ( mi ) H t . 

H\rri2 

Using (P2U1) for the second line below and (Ell) for the third line, we have 


lim (to) = lim F t ( mi ) TT H t (W m2) ) 

m —>00 m —V 00 V / 


£\rri2 


F t m A TT (Mt) • lim IT lim H t CO 

1 -*■ A I x—Yaa n—¥ 00 

t\m A 


x—yoo n —>00 

£<x 

t\m A 


Ft ( TT r " (t) • n Ht 

l\m A ) i\m A 


which gives (iv). 


( 20 ) 


( 21 ) 


□ 


Remark 13. As in the case g = 1, when g = 2 it is possible to derive closed formulae for the quotient 
|GSp 4 ( (z/Ul ; indeed ’ we have 


and 


\C(£,t) | = 


GSp 4 ( Z / ffl )| = £ A (£ - 1)(£ 2 - 1)(£ 4 - 1) 

£ 5 (£-l)(£ 4 -e-1) ift = 0, 
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( 22 ) 







We sketch a proof of the latter using arguments from [CaFoHuSul ; we leave it as an exercise to the reader 
to derive these formulae using the aforementioned results of iKij . Note that we will use these formulae in 
Remark [Ml 
Define 


N llt := 


(x,y,6) € ((Z/a) x y :y^-6, 



It follows from the proof of [CaFoHuSul Theorem 12] that 


\{M £ GSp 4 (Z/£Z) : tr M = f(modf?)}| 


equals 


£ 4 ((£ - l) 2 (i - 2) + N iit ) + e 4 (l - l){£ 2 - l) 2 +- 1) 2 (£ 3 -£-!) + 


(f-e 4 )(£- 1) if i = 0, 
0 iff^O. 


We will now show that 


{l - 2) 2 


if t = 0, 
if t ^ 0, 


which in turns confirms (1M1) . 
Note that 


{(*, y, S ) g ((Z/ffl)*) 3 -.y^-S} \ = (£- lf(£ - 2) 


and 


iV/,o = 


{x,y,S)e ((Z/a) x ) 3 :y^-6, (x + |) (l + 0 = 0 


= (*-!)(£- 2 ), 


since, for any given x, the defining conditions of these sets determines y uniquely, provided that S ^ —y. 
Putting the two together, we obtain that 


c,y,6)€((Z/£Z) x ) 3 :y^-5,(x+^) (l + 0 ^ oj 




Dividing by t — 1, we deduce that N^t — — 2) 2 for any fixed nonzero t\ this completes the proof of 
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3. Proof of Theorem [T] 


For a prime £ and an integer t, define: 


G t 

:= GSp 2ff (Z,); 


PG e 

:= G t /Z{G t y, 


n : G e 

— > PGe the canonical projection; 

G e 

:= Im p A ,e; 


G' e 

■■= n (Ge); 


Q (t) 

:= {M £ Ge : tr M =t}; 

Ct{t) 

■= { M £ Ge : tr M = t} ; 

cm 

:= n(Ci(0)); 


r Ce(t) 

:= inf dim 

MeC e (,t) 

G t 

z Ge {My 

r C’ e ( 0) 

:= inf dim 

mgC'(o) 

G’e 

z G ' t m 


We will deduce Theorem [T] from the following more general result: 


Theorem 


14. Let A/Q be a principally polarized abelian variety of dimension g and let t £ Z. 


(i) Assume that there exists a prime £ such that: 

(a) Ge is open in Ge; 

(b) 3 0 < d < dimG^ such that dim^j Ce(t) < d. 
Define 

dim G — d 
dim G^ 


Then for any e > 0 we have: 
(il) unconditionally, 


(i2) under GRH, 


n A (x,t) 


(log x) 


1 + 0 ! — £ 5 


TTa(x, t) <^A/,e X 1 S +£ . 


(ii) If t Y ±2 g, assume that there exists a prime £ such that: 

(a) Ge is open in Ge; 

(b) 3 0 < d < dimGf such that dirndl Gg(t) < d; 

( c ) Mjj) i L °- 

Define 

dim Gf — d 
^ dim G^ — ' ° e 2 {t> 


(23) 

(24) 
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Then rc e (t) > 0 and the equations \23\) and \‘2J$ hold with a replaced by /3. 
(iii) If t = 0, assume that there exists a prime I such that: 

(a) Gt is open in G#; 

(b) 3 0 < d < dimPG^ such that dim^j C' e (0) < d. 

Define 

dim Ge — 1 — d 

7 ' dimG*- 1 — r -^P- 

Then rc' t ( o) > 0 a nd the equations f£3j) and f24\ ) hold with a replaced by 7. 


Proof. Throughout the proof we let x > 0, to be thought of as approaching 00. 

(i) Observe that, by ©, for any rational prime i we have 


TT A (x,t) < n Ce (t)(x, 


where 


L := 


-j=-Ker p A ,i 


It remains to estimate nc e (t){x, L/Q), which we do by following the method of [Se8lt Section 8]. 

We choose £ as in the hypothesis of (i). Note that since Gg is open in G^, we have dimG^ = dirnG^. We 
apply Theorem [lU] to the extension L/Q and the conjugacy set Cg(t) with D := dirnG^. 

(ii) If t ^ ±2g, we choose £ as in the hypothesis of (ii). As before, dimG^ = dimG^. Moreover, 

Q(i) O Z(G*) = 0, 

for, otherwise, recalling that Z{Gf) = {pl 2 g '■ P € If/ }, we would have that the Gadic valuation of 7^ satisfies 


Vi 


(*) 


= 0, a contradiction. 

In particular, for any M £ Ce(t), 

Z Gt (M)C G t . (25) 

Centralizers are closed subgroups, hence Lie subgroups, and Z Gf: (M) has a well-defined dimension. Since 
GSp 2g is connected as an algebraic group, (l25l) implies that 

dim Z Ge (M) < dirnG^ = dimGf. 

If M £ Ce(t), then dim Zc e (M) < dim Z Ge (M) and, by the above, 

G e 


dim ■ 


> dimGf — dim Z Ge (M) > 1. 


Z Ge (M) 

Therefore we can improve upon the result of (i) by applying Theorem [TT] to the extension L/Q and the 
conjugacy set Ce(t) with D := dimGf. 

(iii) If t = 0, we choose £ as in the hypothesis of (iii) and with pA,e := II o pa 7 we consider 

L' :=0 Ker ^, 
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a Galois extension of Q with Galois group G Observing that 

ttaOg 0) < n c ^ 0) (x,L'/Q), 
it remains to estimate the right hand side. 

Since Gt is open in G^, we have that G\ is open in PGi and so dimG^ = dimPG^ = dimGf — 1. Moreover, 
since Z(PGe) = {h g }, we have 

n(Q(0)) O Z(PG e ) = 0. 

In particular, as in the proof of part (ii), for any M £ C^(0), 

Z PGe (n(M)) C PG e , 


thus 

dimZpG f (II(M)) < dimG^ — 1. 

If M £ Q(0), then dim Zq^ (II(M)) < dim Zp Gl (Jl(M)) and, by the above, 

dim — mi m\\ - dimPG ^ ~ dim Z PGl (U(M)) > 1. 

ZG' t \P\ M )) 

Therefore we can improve upon the result of (i) by applying Theorem [TT] to the extension L '/Q and the 
conjugacy set C^(0) with D := dimG« — 1. □ 


Proof of Theorem QJ In our setting, by the openness assumption on Imp a, hypothesis (a) of Theorem ITT! 
holds for any prime £. It remains to verify hypothesis (b) and to compute the values of a, /? and 7. 

To verify hypothesis (b) of either parts (i) or (ii), observe that Q(t) is a closed subvariety of the algebraic 
group GSp 2g and so C/ft) has a well-defined dimension strictly smaller than dirnGp The bound applies to 
the Minkowski dimension dim^n Cg(t) also, by |Se81l Theorem 8]. Part (b) follows with d := dimG^ — 1. 

To verify hypothesis (b) of part (iii), observe that II(Q(0)) is a closed subvariety of the algebraic group 
PGg and so C' e (0) has a well-defined dimension strictly smaller than dimPG/?. The bound applies to the 
Minkowski dimension dim^ C^(0) also by |Se811 Theorem 8]. Part (b) follows with d := dimG^ — 2. 

Recalling that dim GSp 2g = 2 g 2 + g + 1, we see that a = 2g i + g +i • 

If g = 1, then rc e (t) and rc t { 0) are calculated as in jSe811 pp. 189-190], giving rise to /3 = ^ and 7=5- If 
g > 2, then rc e {t) and ?'c«(0) are estimated using Serre’s Theorem in Appendix 1X1 Indeed, by this theorem 
and Remark 5 that follows its statement, for M £ Ce(t) with t as in (ii) we have 

G e Ge 

r c .(t) = inf dim———— = inf dim———— > 4g — 4, 

Mec e (t) Za e (M) MeCRt) Z Ge (M) 


which gives 


> 


1 


2g 2 - 9 + 3' 

To improve upon this bound when t = 0, we focus on estimating 7 and use 


dim Zp Ge (II(M)) = dim Z Ge (M) - 1 . 


(26) 
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If g = 2, we use (EH1) and once again the first part of the Theorem in Appendix [A] to deduce 

1 _ 1 

^ - ( 2 5 2 + 3 + l)-l-4^4 - g- 

If g > 3, we use (l26l) and the last part of the Theorem in Appendix lAl to deduce 

1 i 

7 “ ( 2 5 2 + 3 + 1 )_ 1_^2 - 2g*-g + \- 

This completes the proof of Theorem [Tj □ 


Proof of Corollary [H The proof of Corollary [2] is deduced easily from part (i) of Theorem |T] and the Prime 
Number Theorem, as follows. Unconditionally, 

7 r(a 0 = #{p < x : p\N A } + # {p <x:p\N Al |ai, p | > (logp) a_£ } + # {p < x :p\N A ,\ai, P \ < (logp) a_£ } 

l 

= #{p < x : p\N A , |ai, p | > (logp)“- £ } + 0 , 4 ( 1 ) + O 


= #{p < x : p\N A , |ai, p | > (logp)“ £ } + 0^(1) + Oa, e ^ 
= # {p < x : p \ N a , |ai iP | > (logp)“- £ } + o (n(x )). 


X KA(x,t) 

1+cWf ■ ( l0 g*) e 


te z 

|t|<(log x) a ~ £ 

X 


(log a :) 1 


Under GRH, 


n(x) = #{p<x:p\N A } + #{p<x:p\N A ,\a ltP \>p 2 e } + # {p < x : p \ N A , |ai )P | < p = £ } 


= #{p<x:p]NA,\ai t p\>p* £ } + 0 ^( 1 )+ 0 


( 


V, 


\ 


X n A{x,t) 




= # {p < x :p\ N a , |ai,p| > £ } + 0,4(1) + Oa, £ {x 1 • x* e ) 

= #{p<x :p\N A ,\a ltP \ > p^~ e ) +o(7r(x)). 

Note that the uniformity in t of the bounds for 7 r A (x,t) provided by Theorem |T] was crucial in the above 
estimates. □ 


4. Proof of Theorem [3] 

Let A/Q be a principally polarized abelian variety of dimension g such that Imp 4 is open in GSp 2 p (Z). 
We will investigate v{ai )P ) via the method of moments, with the goal of proving: 


Proposition 15. Assume GRH. Then 


-rr X M a bp) -l°gloga;) fe 

< x ) jzL 

p\N A 
a l ,p 7^0 


Cfc(log logx) 2 +0 ((log log x) 


(27) 
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for each integer k > 1, where 


k\ 


if k even 


c k :={ 2 +#) ! 

0 if k odd 

is the k-th moment of the standard Gaussian. 

With this, by adapting to our context the proof of the Erdos-Kac Theorem due to P. Billingsley IBi74| (see 
also |Bi69l and the references therein for an accessible exposition), Theorem [3] is proved. 

The core ingredient in our proof is the following application of © - ©, Theorem [8] (under GRH) and 
Proposition EB for any positive integer m and any x > 0 (to be thought of as approaching infinity), we have 

I^V,o)| 




|G(m)| 


-7r(*) + O ^|C(to, 0)|+ \og(mNAx)^ . 


(28) 


Related to this, remark that by the openness assumption of Im pa in GSp 2s (Z) and by © from the proof 
of part (iii) of Lemma [T21 we have 

!<?(*, o)| 


|G(£)| 


for all i \ mA ■ In particular, for any y > 0, 


E 

i<y 


TOO) I 

|G(£)| 


" T+0( P 


= log logy T 0^(1), 


and, after using HMD and 0, 


E |G(e, 0)| « 

£<y 


y 


2 9 + 5+1 


logy 


(29) 


(30) 


(31) 


Crucial to the method is also the following simple observation. Let x > 0 and 0 < 5 < 1 be fixed and let 
y := x s . For any integer m > 1, we have 

log TO 


\v{m) - v y [m)\ < 


(32) 


5 log x ’ 

where v v {jn) denotes the number of distinct prime divisors i < y of to. 

We now proceed with the proof of (EH. For each prime £, we define a random variable Re to be 1 with 
probability j and 0 with probability 1 — j. Upon taking y := x s for some fixed 0 < S < 1 and x —> oo, 

R{y) := E Re becomes normally distributed with mean and variance each equal to log log a;; by the Central 

e< y 

Limit Theorem, for any integer k > 1 we have 

E ((i?(y) - log log a+) = Cfc(log loga;)^ + o ((loglogz)^ . (33) 

Note that by (1291) . Re models the event that ^|ai iP for some p. Our strategy then is to prove (1271) by 
comparing E (( R(y ) — loglog:r) fc ) and ^ (i/ y (ai iP ) — log log a+ for each k > 1. 


P\N a 

a l,p^0 


We fix x > 0 and k > 1, choose a parameter S = S(g,k) such that 

1 


0 < 6 < 


2k {fig 1 + y + 1) : 
20 


(34) 













and define y := x 5 . In what follows, our O-estimates will reflect the growth of various functions as x —> oo. 
For each £ and each p ] N A , we define 


h(p) ■= 


1 if £\a liP , 
0 else. 


Then, for each integer 1 < j < k. upon applying (l28l) - (1311) and (l33l) . we obtain 


Y v y{ a hp) J 

p<£C 

p\N A 

a l,p^o 

= Y (p) • • • hi (p) 

a l,p^O 

= Y #{p<x'-P\N A ,ai tP ^0,lcm.{£ 1 ,...,e j }\ai :P } 

= Y #{p ^ x '■ P\ N AAcm{£ ll .. . ,^}|ai iP } + 0(7r(y) J tt a (x,0)) 

*i,-i tj<v 

= Y #{P< X ■P\^m{£ 1 ,...,£ j }N A ,lcm{£ 1 ,...,£ j }\ai iP } 

+ Y #{p < x '■ p\N a ,p\ lcm{4,... ,£j}\a ltP } + 0(Tr(y) j 7 ^( 2 :, 0)) 

h,...,£j<y 

= X! 7r C(icm{£ 1 ,...,^},0 )( x > Q(vl[lcm{Ti,..., £j}])/Q) + O (jTr(yy) + O (tt a (x, 0) tt( y) J ) 

ti,-,tj<y 

. „ / u f(29 2 +ff+l) , \ 

= E(I?(2/) j ) tt(x) + Oj (tt(x) (loglog y) J x ) + Oaj [ (\ ogy y x2 lo % x J + ( 7r (2/)' ?7r ^( a: > °)) • 


By the binomial theorem and the above, we deduce 


X] K(«i,p) - loglogx) fe 

p<x 

p\n a 

a l,p^® 

0<i<k ^ ' p<* 

Pt-^A 

a l,p^o 

= Y ( fc )( _1 °g 1 °g a: ) fc_ ' 7 7r ( ;c ) 

0 <j<k 

+ 0 A ,k (y H2g2+9+1) xi(logx) (loglogx) fc ) + O fc (n(y) k n A (x,0) (loglogx) fc ) . 

Recalling the choice of S given in (l34l) and using part (i2) of Theorem [H we see that the two O-terms above 

become O e ,A,k (x 1 ~ E (logx)(loglogx) fc ), which is o ^7r(x)(loglogx)^. Then, upon applying the binomial 
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theorem once again in order to rewrite the first term, we deduce 


E K(ai, P )-logloga:) fc ~E(( J R(y)-logloga;) fc ). (35) 

' ' p <x 

p+N A 

a l,p^O 


Finally, recalling (0 and (l32l) and applying (l33l) and (131^1 several times, we deduce 


—— V (y(ai p ) — loglogx) fc 

*K X ) tzL 

v\n a 

“l,p#° 


1 

7r(x) 


E 

p<x 

v\n a 

a l 


(vyi a l,p) - log log X + O 


/logjaypl 
\ S\ogx 


k 


( 


\ 


1 

7r(x) 


y" (v y (ai,p) - log logx) fc + O k , g ,s 

p<x 

v\n a 

a l,p7^0 


E 

o<i</c-i 

V 


1 

7r(x) 


E 

p<x 

v\n a 

a l,p^® 


K(ai, P ) - log log x^ 


/ 


Et E K(°i.p) -loglogx) fc + O fc ((loglogx)V^ 

' ' p < X 

p+iV A 
a l ,p ^0 


= C/c (log log x) ^ +0 ((log log x) 2 ) . 


This completes the proof of Theorem [3] 


Remark 16. The first and second moments of v(ai tP ) may be estimated directly, without any comparison 
with the model defined by Re. The strategy originates in P. Turan’s proof of the Hardy-Ramanujan Theorem, 
ESI, and is summarized below. 


We choose 0 < S < g g a + 1 4g+1 and let y = x 5 . Then, proceeding as in the proof of Theorem [3] but without 
the model Re, we obtain 
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E ( l/ («i,p) - log log a;) 2 

p<x 

v\N A 

a l,p7^0 

= E ^( a i,p) 2 - 2 (loglogx) Y ^{ a i,p) + ^ o S^ogx) 2 #{p<x:p\N A ,a 1 ^ p ^0} 

p<x p<x 

p\n a p\n a 

a l,p7^0 a l ,p^0 

= Y K( a i,p)+ °^( 1 )) 2 

p < a; 
p+iV A 
a l,p7^0 

-2(loglogx) ^ (^(a^p) + Oa( 1)) + 7r(x)(loglogx) 2 + 0 (tta(x, 0) (loglogx) 2 ) 

p<x 

Pt^A 

a l ,P 7^0 


= E ^(oijp) 2 — 2(loglogx) Y Vy{ ai , p ) + ir(x){\og\ogxf 


P<£C 

Pt^A 

a l,p7^0 


p < a; 

Pt^A 

a l,p7^0 


( \ 


+ 0 


E 

p<x 

p\ N A 

\ a l,p7^0 


^(ai,p) 


/ 


+ 0(7r(x) log log x) + 0(tta(x, 0) (log log x) 2 ) 


= Y 


£ i># 2 <v 

*19^2 


\C(h( 2,0)1 

\G(hh)\ 


n(x) + 0 A Y, |C(^i^ 2,0 )|x 2 log a; 




2(log log x) y ^ 


+ 0 A 


Y\ c WMx* (log x) (log log x) 


\(-<v 


+ 7r(x)(log logo;) 2 + Oa 



1 ^0)1 

\G{i)\ 



+ Oa ( E 0)|x2 log a: J + 0(7r(x) logloga:) + 0(tt a (x, 0) (logloga;) 2 ) 
\t<v 


= tt(x) (log logx) 2 + 0 A 


28(2g 2 +g+l) \ . s 

-x 5 J — 27r(x) (log logx) 2 +0 (x s ^ 2g +ff+1 l x 5 log log xj 


logx 


+ 7r(x)(loglogx) 2 + Oa (7r(x) log logx) + Oa (x s ^ 2g +9+1 ) x= logx^) + Oa (7ta(x, 0) (log logx) 2 ) 


= Oa ( 7r(x) log logx). 


(36) 


Note that the cancellation of the 7r(x)(loglogx) 2 terms is essential and that the choice of 5 ensures that 
the largest emerging O-term depending on y, namely Oa ^-— \o g + 8+ ? x^ , is sufficiently small; precisely, it 
is <Ca 7t(x) <Ca 7t(x) log logx. 
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Remark 17. That v{a\, p ) has normal order log log p can be deduced easily from the second moment 
estimate (15C>1) . In particular, this is an immediate consequence of the following variation of (15C>1) : 

Y ,p) ~ lo S lo g P ) 2 <A n(x) log log x. 

p<.x 

p\n a 

a l,p 

In turn, this is obtained by remarking that 

Y (r(ai,p)-loglog pf <C Y (^(ai.p)-loglogo;) 2 + Y ( log l^|“) ’ 

p< X p<CC p<£E ' ° / 

p\n a p\n a p\n a 

a l,p7^ 0 a l,p7^ 0 a l,p7^ 0 

using (EH) for the first sum and splitting the last sum over p into a sum over p < yfx and one over yfx < p < x, 
followed by elementary estimates. 

Remark 18. The normal order of v(a\ iP ) may also be obtained via the ubiquitous large sieve; see [Kol 
Proposition 2.15] for generalities related to such works. Moreover, the fc-th moments (1271) may be estimated 
more precisely via sieve methods by applying the general result |GrSol Proposition 3]. 

5. Heuristic reasoning for Conjecture [4] 

We devote this section to arguing heuristically towards Conjecture |U Our main setting will be that of 
a principally polarized abelian variety A/Q of dimension g for which Imp^ is open in GSp 29 (Z) and which 
satisfies the Equidistribution Assumption. In particular, the function $ introduced in Section Q] is bounded, 
continuous, and nonzero on (—1,1); this was proved in more than one way in email communication between 
N. Katz jKa!5] and J-P. Serre; in Appendix |B] we include a letter from Serre to Katz that contains such a 
proof. 


Definition 19. For each integer m > 1 and prime p, define c Pt m £ (0, oo) by 

|G(m)| 


C"D.m — 


m 


5 4 (%k) |C(ra - r)l 


rez 

M<2 gy/p 


and define the function 


/*j m ) : Z —> [0, oo), 


f(m) 

Jp 


( T ) 



ra|C'(ra,r)| ^ 
|G(m)| ‘ C P’ m 

0 


if M < 2gy/p, 
else. 


Note that 

E4 m E) = i- 

T(zZ 
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Lemma 20. For all integers m > 1 and To £ Z we have 


lira ——— 

p -*oo 2 g^rp 


E 


$ 


|r|<2g v /p 
t = tq (mod m) 


2gVP 


= l. 


Proof. This follows by viewing the expression inside the limit as a Riemann sum approximation of the integral 

rl 

a 


j <h(r) dr = 1. For more details, see [LaTrl pp. 31-32]. 
Lemma 21. For all integers to > 1 we have 


lim 2 g^pp c p , m = 1. 

p—> OO 


Proof. By the definition of c p m and Lemma EU1 


m —1 


lim - 


= lim 


p->oo 2gpp 


E E 

T0 —0 ^62 

I t | < 2g v /p 
t = tq (mod m) 


/ T \ TO |G(to, r)| 

\^9VpJ |G(m)| 


= lim V 

T)—¥CO * ^ 


|C(to,t 0 )| 


p->oo ^—' |G(to)| 

r 0 =0 1 v n 


yt \C(m,T 0 )\ 
= 1. 


TO 


2ffv^ 


E 


$ 


t£Z 

M<2g,/p 
t = tq (mod m) 


2^^ 


□ 


Now let us fix t £ Z and assume that lim fp m \t) models the likelihood of the event cti, p = t, as guided 

m —y oo 

by the Chebotarev law for all TO-division fields and by the behaviour of 5^7= in the interval (—1,1). Then, 
recalling part (iv) of Lemma IT2l and Lemma [2ll we reason heuristically as follows: 


#{p < x : p f N a , oi iP = t} 

Inn y/i ro) (t) 


m —y oo 


p<x 


= linr $ 


p<x 


m\C(m, i)| 
%9y/p) \ G ( m )\ 


Cn 


lim 

m —y oo 


?n|C(TO,t)| 

|G(to)| 


= ( lim F t (to) ] y $ 

p<x 


m —>■ 00 


E* 

/ t 


ZgppJ 2 9 Vp 


\2gVpJ 2 gVp 


Here, the symbol ss means equality deduced purely heuristically. The last line is simply notation, as intro¬ 
duced in Section 2.2. 
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To understand the growth of the last sum, we use the properties of the function <f>. For any e > 0, by the 
continuity of $ at 0 , there exists a 6 > 0 such that 


t 


2gVP 


< s 


$ 


t 




-m 


< £. 


(37) 


We thus split the sum over p < x according to the above (5-interval. By the boundedness of we obtain 


E * 




t 1 


2 g^p 


2 Vp 


^*,£,9 I' 


By (j37j) and by noting that ^ 


1 


p<x 


\fx 

2 a/p log ^ 


, we obtain 


E 

t£j?<P< x 





£\J~X 
log 2 


Taking e —> 0 and returning to our heuristics, we are led to the possible prediction that 

#{p < x : p \ N a , a\ p = t} ~ ■ lim F t (m) ■ _E_. ( 38 ) 

g m-y 00 log X 

When t / 0, we proved in parts (iii) and (iv) of Lemma [12] that the limit over m 00 exists and equals 
an infinite product; in this case, we conjecture that 


#{p < x : p \ N a , ai tP = t}~ 

m m A , t \C(m A , u t)\ ^W+ 1 |{MGGSp 2s (Z/^W+ 1 Z):trM = t(mod^«+ 1 )}| ^ 

g ' \G(m A ,t)\ ' e f} A | GSp 2s (Z/^W+ 1 Z)| log a;’ 1 J 

where we recall 

m A ,t = m A t VeW - 

t\m A 

When t = 0 and g = 1, the limit over m —£ 00 exists and equals an infinite product by ILaTrl Lemma 2 
p. 34]; see Remark [55] below. When t = 0 and g > 2, we are currently unable to make a similar statement 
and relegate such a study to future work. 

We conclude this section with several remarks about the above conjecture. 

Remark 22. Assume g = 1 and End^/E 1 ) ~ Z. Then Imp^ is open in GSp 2g (Z) (see [Se72j j and the 
Equidistribution Assumption holds (see iBLGeHaTaj . |ClHaTa| . and [C]]). In this case, $(a;) = |Vl — x 2 
and (1351) coincides with the formulation in ([]]) of the Lang-Trotter Conjecture on Frobenius traces of ILaTrl . 
Combining this with the formula 

|GL 2 (Z/«)| = £(£ - 1) (t 2 - 1) 
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and with (LaTrl Lemma 2 p. 34], we obtain an equivalent reformulation of (1381) : 


2 mA\C(m,A,t)\ T-r £ 2 -pr £ (£ 2 £ l) y/x 

K \G(m A )\ A1 (2 _ 1 (£ +1 )(£- !)2 loga; - 


( 40 ) 


Remark 23. Assume g = 2 and Endqj(A) ~ Z. Then Im p A is open in GSp 29 (Z) ( [Se86j . |Se86bis] 'l and 
the Sato-Tate group of A is USp(4) ( [FiKeRoSu . Theorem 4.3]), while the Equidistribution Assumption is 
an open question. The function $(•) may be calculated explicitly using the Weyl integration formula as in 
KeSul . In particular, this calculation leads to the value 
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$(0) = 


157T 2 


We explain the calculation of 4>(0) here briefly. Let L p (A,T) := T 4 Pa, p (y) be the p-Euler factor in the 
L-function of A and let L p (A,T) = L p ^A, be its normalization. Let 

S := |(xi,X2) £ I 2 :12 > 2xi — 2,x 2 > —2xi — 2, X 2 < + 2^ 

and let R(x 1 ) be the defining interval of X 2 imposed by the constraints of S. Recalling that the Sato-Tate 
group associated to A is USp(4), the conjectured joint density function of the normalized coefficients ai iP 
and <X 2 ,p is 

— yjma,x{p(a 1>p , d 2 , p ), 0 }, 

where 

p(x 1 , X 2 ) := ( x\ - 4cc2 + 8) {x 2 - 2xi + 2) (x 2 + 2xi + 2), 
with support in the region S where p is non-negative. Consequently, for any interval I C [—4,4], the set 

{p : di, P € 1} 

is expected to have natural density 

[ [ -i»-v / max{p(xi,X 2 ), 0 } dx 2 dx±. 

Ji Jr(x 1 ) 4tt 

(For details, see the original source, specifically IFiKeRoSuI p. 21 and p. 40].) Let 

^(z) = T~o I V ma x{p(x, x 2 ), 0 } dx 2 . 

4tt J R ( x ) 

In particular, R(0) = [—2, 2] and 

1 r 2 _ 

*(0) = ^ J \/(8 - 4x 2 )(x2 + 2) 2 dx 2 = 


64 

157T 2 


In our notation $(x) = 4t(4x) • 4, since one can rescale the variable and account for the fact that both 
functions are assumed to have integral 1. Therefore, $(0) = 'L(O) • 4 = 
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Remark 24. For g = 2, t = ±1, and Endj^A) ~ Z, we have an equivalent reformulation of (1M1) : 


7 T A (x,t) 


128 

157T 2 


m A \C(m A ,t)\ 

\G(m A )\ 


1—r £{£ 6 -£ 5 -£ 4 + £ + 1 ) 

11 «-!)(*-W-i) 



This is obtained by combining (1221) with the value of $(0) from the previous remark and with the formula 


I GS P4 (z/ffl)| = e 4 (i -1)(£ 2 - i)(e 4 -1). 


Remark 25. For higher g, the function $ is shown to have a certain general form in Appendix [B] It may 
again be calculated explicitly using for example [Wei Theorem 7.8.B] and jKSl 5.0.4] (see also the upcoming 
IBuFiKel b 

Remark 26. For g = 1, a more refined version of m was proposed in [BaJol : for higher g, similar 
refinements are relegated to future work. 


Remark 27. Variations of our Conjecture 0] may be formulated for non-generic classes of abelian varieties 
such as the case of a CM elliptic curve E/Q (which was already considered in |LaTr] 1; in such cases, both 
the assumption on the image of p A and the Equidistribution Assumption must be modified appropriately. 
We relegate such endeavours to future work. 


6. Computations 


The Lang-Trotter Conjecture as formulated in flUl) has been supported by numerical evidence (see ILaTrl . 
ICaHuJaJoScSmj . and ICoFilnYlj b Among the main ensuing difficulties are the computations of the integer 
m A and of the quotient . These may be resolved for g = 1 by working with a Serre curve, i.e., 


an elliptic curve for which 


GL. 


(£): 


Im p A 


= 2. For such a curve, the integer m A is the least common 
multiple of 2 and the discriminant of Q (x/Aa) , where is the discriminant of any Weierstrass equation 
of A ; see [Jo] Section 4, p. 1558]. As proved in [Jo] and later in |CoGrJo| . in more than one sense almost all 
elliptic curves are Serre curves. Examples of such curves, as exhibited by Serre in [Se721 pp. 310-311] and 
by H. Daniels in [Dal p. 227], have been used for numerical computations in ILaTr] and [CoFilnYl] . 

For higher g, the investigation of m A from a computational perspective is a solid problem in itself that 
remains to be tackled. In this section, while we do not provide numerical evidence for Conjectured] we do 
provide some computational data that complements our main theoretical results. 


6.1. Values of n A (x,t)- Figures [T] and [2] show the values of n A (x,t) graphed versus -Jx/\ogx for t £ {0,1} 
and A £ { Ji, J 2 , J 3 }, where Ji, J 2 , J 3 are the Jacobians of the hyperelliptic curves listed in Tabled Prediction 
(l38l) would imply that these graphs approximate a straight line, whose slope is determined by the constant 
in front of y/x / log rc; the graphs are indeed consistent with this implication. 
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Jacobian 

hyperelliptic curve 

genus 

comments 

J\ 

y 2 = x 5 — x + 1 

2 

good reduction outside {2,19,151}, End( J\) = Z (DU p.509] 

J2 

y 2 = 4x 7 — 12x — 35 

3 

everywhere semistable. EndfJ?) = Z Zal4l d.2] 

J 3 

y 2 = 4a : 9 — 8 a: — 39 

4 

everywhere semistable, End( J 3 ) = Z [Zal4 ( p.2] 


Table 1. Jacobians of hyperelliptic curves used in computations. 



Figure 1 . Values of tta{ a;, 0 ) versus ^Jx/logx for various Jacobians of hyperelliptic curves. 



Figure 2 . Values of 7^4 (x, 1 ) versus ^Jxj log* for various Jacobians of hyperelliptic curves. 
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6.2. Converging products of Lemma ll2l In part (iii) of Lemma IT2l we showed that the following infinite 
product converges for all integers t and all integers g > 1 : 

i ■ \{M e GSp 2 ff (Z/^Z) : tr M = f(mod£)}| 

I GS P 2 g (Z/«)| ' 

The numerical value of this product depends on the genus g and the primes dividing the trace t (more 
precisely, the numerator of each factor depends only on whether or not i | t). It is possible to compute its 
value for various g and t. For example, when g = 2 we can use the explicit formulae of Remark 1131 In that 
case, for t £ { 0 , 1 }, numerical computations show that the products appear to quickly converge to 

P 2 , 0 « 1.3547..., P 2 ,i « 0.7988.... 

6.3. The normal order of i/(ai }P ). Figure [3] shows the average number of v{a\^ p ) for Ji of Table [I] for p 
in the intervals [2 ,_ 1 ,2®], i = 2,...,21. The graphs of log log 2* and log log 2 1-1 are shown for comparison. 
Figure [I] presents histograms of the values of v{a\ tP ) for J\ in two intervals: [1,2 20 ] and [2 20 ,2 21 ]. The 
corresponding histograms for J 2 and J 3 are very similar. 



u 

,03 

Q3 

a 

a 

4-5 

o 


0 ) 


0 

0 

OP 

bjO 

?—1 
CP 
> 
c 



Figure 3. Average number of i/(ai jP ) for J 1? J 2 and J 3 , in the intervals [2 Z_ 1 ,2*], i = 
2,..., 21. For comparison, the graphs of log(log(2 2 )) and log(log(2 2-1 )) are shown in dotted 
lines. 
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Number of distinct prime factors 


SO 



Number of distinct prime factors 


Figure 4. Histograms of i/(ai, p ) for Ji; on the left, the data is for primes p < 2 20 , and on 
the right, the data is for primes 2 20 < p < 2 21 . Primes of bad reduction and primes for 
which the trace is zero are excluded. 


Appendix A. Letter by J-P. Serre on dimension of conjugacy classes in symplectic groups 
Paris, May 8, 2015 

Dear professor Cojocaru, 

In case you want optimal estimates for the dimensions of conjugacy classes in Sp and GSp, here is what 
one can say: 

Let us consider the algebraic groups G = GSp 2n or Sp 2n over a field k of characteristic 0 (there are some 
small changes in char, p > 0). Assume n > 1, since the case of GL 2 and SL 2 is obvious. If g € G(k), 
let d{g) be the dimension of the conjugacy class of g } viewed as an algebraic subvariety of G; we have 
d(g) = dimG — dim Zc{g), where Zc(g) is the centralizer of g in G. 

Theorem - Assume that g is not of the form cu, where c is in the center of G and u is unipotent. Then 
d(g) ^ 4n — 4. If moreover Tr(g) = 0 and n > 2, we have d(g) ^ 4n — 2. 

A few remarks before giving the proof: 

1) This is a “geometric” statement: we may assume that the ground field is algebraically closed. 

2) We may assume that G = Sp 2n ; the case of GSp 2 „ follows by writing g as product of a scalar and an 
element of Sp 2n ; the dimension of the conjugacy class is the same. 

3) If Tr(g) = 0, then the condition “ g ^ cu ” is satisfied, thanks to the fact that the characteristic does not 
divide 2 n. 
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4) The bounds are optimal. One realizes them by using the obvious embedding l : SL 2 —» G , fixing a non¬ 
degenerate subspace of codimension 2. If one chooses g = i(— 1), the centralizer of g in Sp 2jl is Sp 2n _ 2 x SL 2 ; 
its dimension is 2(n — l ) 2 + n — 1 + 3 = 2 n 2 — 3n + 4; hence the dimension of the conjugacy class of g is 
dirnG — (2?r 2 — 3 n + 4) = 2n 2 + n — (2n 2 — 3 n + 4) = An — 4. If one chooses g = t(x), where x £ SL 2 is 
such that Tr(cc) =2 — 2 n (this is always possible, and gives a non central element because 2 — 2n / ±2), one 
gets an element of trace 0 with centralizer the product of Sp 2ra _ 2 by a group of dimension 1; its dimension 
is 2 n 2 — 3n + 2, and the dimension of its conjugacy class is 4n — 2. 

5) In the £-adic application, one needs the fact that, if g £ GSp 2 „(Zf), the dimension (as an £-adic manifold) 
of the conjugacy class of g is the same as its dimension in the sense of algebraic geometry. 

For a given t £ Z, with t ^ ±2n, one needs to choose £ so that no element of trace t of GSp 2n (Z«) can be 
of the forbidden shape cu ; as you explain in your paper, this is done by taking £ such that vt{t/2ri) ^ 0 , 
which is always possible. 

Proof of d(g) > An — 4. 

We may assume that g is semisimple. Indeed, if we decompose g in Jordan form, as g = su = us, where s 
is semisimple and u is unipotent, the centralizer of g is contained in the centralizer of s, hence d(g) ^ d(s). 

Let us decompose the vector space V = k 2n (with its chosen nondegenerate alternating form) as a direct 
sum of eigenspaces of g, say V = ®Va. These spaces have the following properties: 

a) V\ and V-\ are non degenerate, hence of even dimension; 

b) If A ^ 1, —1, then V\ is totally isotropic, and in duality with V\-i. 

Put n\ = dirnTx- The centralizer of g is : 

Za{g) = Sp ni x Sp„_ i x IT GL„ X , 

where the symbol IT means a product on a set A such that k x is the disjoint union of {1, —1}, A and A -1 . 

[It might be more efficient to use the orthogonal decomposition of V given by the eigenspaces of g + g~ 1 .] 

This implies : 

( 1 ) dim Z G {g) = |(nf + ni + + n_ 1 ) + T!n\, 

where S' means a summation over A £ A. 

We also have: 

( 2 ) 2 n = n\ + n_i + 2Y,'n\. 

We now need to give an upper bound for the sum (1). Let us simplify the notation by putting x = ni/2, y = 
n-i/2,z = Y!n\. Equation (2) becomes: 

(2’) n = x + y + z, 

and equation ( 1 ) implies (using (E'nv ) 2 ^ S'n 2 ): 
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(3) dim Za{g) ^ 2 x 2 + x + 2y 2 + y + z 2 . 


Consider first the case 2 = 0 (i.e. the case where g as order 2). In that case, (1) shows that dim Zc{g) = 
2x 2 + x + 2 y 2 + y = 2 n 2 + n — 4 xy. We have xy ^ 0, otherwise g would be central; hence x and y run between 
1 and n — 1. In that range the product xy is minimum when either x or y is equal to 1, in which case its 
value is n — 1 . Hence dim Za(g) < 2n 2 + n — 4(n — 1 ), i.e. d(g) ^ 4(n — 1), as wanted. 

Suppose 2 > 1; we have x,y > 0. With the relation (2’), this shows that the point ( x,y,z ) £ R 3 
belongs to the triangle with vertices the three points (0,0, n), (0, n — 1,1), (n — 1, 0,1). Since the function 
2cc 2 + x + 2y 2 + y + z 2 is convex, its attains its maximum at one of the vertices [Bol Chap. II, §7.1, prop. 1]; 
its values there are n 2 , 2n 2 — 3n + 2, 2 n 2 — 3n + 2. Since n 2 ^ 2 n 2 — 3n + 2 for n ^ 2, this shows that 
dim Zc(g) ^ 2n 2 — 3n + 2, hence d(g) ^ 4n — 2, and a fortiori d(g) ^ 4n — 4, as wanted. 

[The proof also shows that d(g) = 4n — 4 is only possible when g is an involution of type ± i{— 1), as in 
Remark 4.] 

Proof of d{g) ^ An — 2 when Tr(g) = 0. 

We use the same notation as in the above proof. The case 2 = 0 is possible only if n is even, with 
x = y = n/2. This gives a centralizer of dimension n 2 + n, hence d(g) = n 2 , which is > 4n — 2 when n ^ 4. 
Hence 2 ^ 1 , in which case the computation given above shows that d(g) ^ 4u — 2. 


Best wishes 

J-P. Serre 

Appendix B. Letter by J-P. Serre on the continuity of the density function 
Paris, April 12, 2015 

Dear Katz, 

Thank you very much for your letter about the density problem for USp(2n). 

After writing to you I found a different way of getting the same result, based on an integration formula 
which is a combination of H.Weyl’s formula and a formula of Steinberg jSt[ Lemma 8.2]. 

Let me start with a simple simply connected group G. Let T be a maximal torus, and define the roots, 

weights, fundamental weights as usual. I need to number the fundamental weights: wi,..., u> n , where n is the 

rank. Call x-i. the traces of the corresponding fundamental representations, and call 'ifi their restrictions to 

T (I am copying Steinberg’s notations). Steinberg’s formula is a formula relating the n-differential forms on 
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T given, on one hand by the exterior product of the difi , on the other hand by the exterior product of the 
du>i/u}i [invariant differential on the torus]. The formula is : 


(1) dipi A ... A dip n = f.duii/uji A • • • A 
where f = ui o Tlax^ 1 ~ a_1 ) ancl w o = 

[Note that, here, I am forced to use a multiplicative notation for the roots, since I view them as functions 
on T.\ 

We may write / 2 in a slightly simpler form: 

( 2 ) f=H(a + a- 1 -2). 

a> 0 

This shows that / 2 is real and invariant by the Weyl group. It can thus be written as a polynomial in the 
Xi ; let me call D that polynomial (it is a kind of discriminant: it vanishes only on the singular elements of 
G). We thus have: 


(3) f 2 = D(x 

This formula of Steinberg gives an integration formula over any local field. Here I shall stick to R but I 
have no doubt that the p-adic case should be useful, too. To simplify matters, I shall suppose that -1 is in 
the Weyl group W. 

Let now call UG the compact form of G, and UT the corresponding torus. The roots a, and the characters 
oji are now viewed as functions on UT with complex values of absolute value 1. The Xi are real valued 
functions (because of my assumption on the Weyl group); let me call them Xi\ they give a map x : UG —> R" 
which is well-known (since Elie Cartan [ Cal pp. 803-804]) to have the following properties: 

a) It gives a homeomorphism of the space Cl(UG) onto a compact subset C of R". 

[When G has type G 2 , the set C is the one I asked you to draw for me.] 

b) Let Ct be the standard fundamental domain of W (in the tangent space, it corresponds to the fun¬ 
damental alcove); the map Ct —> C is a homeomorphism; the boundary of C corresponds to the singular 
classes. [I see that by using topological arguments.] 

c) The function D{x 1 , ...,x n ) [where D is as above] is a polynomial whose restriction to C is zero on the 
boundary and nowhere else. 

By combining this with H. Weyl’s integration formula, one finds: 

Theorem - The image by x : UG —► R ra of the normalized Haar measure of G has a continuous density 
[with respect to the standard measure dxi ■ ■ ■ dx n ], namely the function (p(x ±,..., x n ) which is equal to 0 
outside C, and to (27r)~ n \D(xi,Xn)] 1 ^ 2 on C. 
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Corollary - The equidistribution measure associated with a fundamental character of G has a continuous 
density. 

More precisely, the density at a number c of the fundamental character \i is equal to / tp(c, X 2 , ■■■, x n )dx 2 • • • dx n . 

Curiously, this point of view does not seem to give the fact that such densities are real analytic outside a 
finite number of values (namely, those taken by the character at the points of finite order of G corresponding 
to the vertices of the alcove, i.e. the points of G of order 1 or 2 when G = Sp 2rl ). 

One can also say when the density is not 0; for instance, for the trace when G = Sp 2rl the density is 
nonzero when the trace c is such that —2 n < c < 2 n. 

When -1 is not in the Weyl group, some fundamental characters come in pairs of conjugate ones, and 
instead of R” one should take a product of copies of R and C- The case of SL 3 is especially nice; the 
compact C lies inside C, and is the interior (+ boundary) of a “hypocycloid with 3 cusps” (hypocyclode 
trois rebroussements - as I learned when preparing the ENS competition in 1944-45). 

Best wishes 

J-P. Serre 

PS - The explicit formula for tp in the case of Sp 4 is given in the paper of Fite, Kedlaya and others [FiKeRoSul : 
see Table 5, last line. Note that their a 1 is my X\ and their a -2 is my X 2 + 1. 
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